Method and device of stroke based user input

ABSTRACT

A method of inputting a character to a computing unit. The method comprises capturing a stroke drawn by a user in relation to a reference zone, identifying a combination of a shape and a relative position of the stroke in relation to the reference zone, automatically selecting one of a plurality of characters from according the combination, and providing the selected character as an input to the computing unit from the user.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/058,015 filed on Feb. 8, 2011, which is a National Phase of PCTPatent Application No. PCT/IL2009/000767 having International filingdate of Aug. 6, 2009, which claims the benefit of priority of U.S.Provisional Patent Application No. 61/188,231 filed on Aug. 8, 2008. Thecontents of the above applications are all incorporated herein byreference.

FIELD AND BACKGROUND OF THE INVENTION

The present invention, in some embodiments thereof, relates to methodand system for user interface and, more particularly, but notexclusively, to a method and system for user interface based on strokes.

As electronic devices have more and more the functionalities, the demandfor alphanumeric input and extended controls having a limited size andcan be easily integrated is increased. Several solutions for data entryfor such devices exist like compact keyboards, handwriting recognition,and voice recognition.

Among the possible solutions, handwriting recognition is one of the morepopular solutions because it is intuitive, fast, and requires a smallfootprint on a device. Different handwriting recognition based methodsand devices are known and some of them require inputting only special,simplified strokes, for example Unistroke™ from the Xerox Corporationand Graffiti™ from Palm, Inc. Some of the handwriting recognition basedmethods and devices require the use of a stylus or pen as an inputdevice and a high resolution input device such as a pressure sensitiveor resistive touchpad.

For example, U.S. Pat. No. 7,519,748, issued on Apr. 14, 2009, describesa data entry system comprising of: an input surface, a limited number ofinput elements of any shape and positions at the input surface, and aprocessing device (for detecting a continuous sweeps of an input objectover the input surface, for tracking a sequence of the input elementsinteracted with the input object during such sweeps, and for generatinga function associated with the sequence after the sweep is completed). Asystem characterized in that the processing device is adapted for timeindependent and reliable detecting a sequence of input elements, even ifan input object could interact with several input elementssimultaneously.

Another exemplary stroke based input method and system is described inU.S. Pat. No. 6,731,803 issued on May 4, 2004 and suitable for hand heldprocessor implemented devices with small touch pad writing surfaces. Thewriting surface is divided into a grid by a number of spaced discretepoints. The user is instructed to write, as by a stylus, characters suchas alphabetic characters, numbers or symbols with the writing pathextending through a predetermined sequence of the points which definethe grid. The stylus must pass sequentially within a specified distanceof mandatory points for processor recognition of each written characterand may additionally pass within a predetermined distance of optionalpoints.

SUMMARY OF THE INVENTION

According to some embodiments of the present invention there is provideda method of inputting a character to a computing unit. The methodcomprises capturing a stroke drawn by a user in relation to a referencezone, identifying a combination of a shape and a relative position ofthe stroke in relation to the reference zone, automatically selectingone of a plurality of characters from according the combination, andproviding the selected character as an input to the computing unit fromthe user.

Optionally, the combination depicts a form indicative of the selectedcharacter.

Optionally, the method further comprises sequentially repeating thecapturing, the identifying the selecting, and the providing so as tocreate a text paragraph.

Optionally, the reference zone is a virtual circle, the capturingfurther comprising displaying the reference zone on a touch screen.

Optionally, the stroke is a continuous touch gesture of the user on atouch screen.

More optionally, the user uses a thumb for performing the stroke.

Optionally, the method further comprises dynamically changing the sizeof the reference zone according to the captured stroke.

Optionally, the method further comprises adjusting the selectedcharacter according to a member of a group consisting of: a pressureapplied during the stroke, a direction of the stroke, a pace of thestroke, a pressure applied on an input surface performing the capturing,an additional input received by a device performing the capturing, andan additional stroke performed by a touch gesture on an input surfaceperforming the capturing.

More optionally, the adjusting comprises selecting between an upper caseand a lower case of the character.

Optionally, the stroke is a touch gesture applied on an input surface.

Optionally, the method further comprises detecting an interlude in amovement a pointing element used for performing the stroke, theidentifying being performed according to the combination and theinterlude.

More optionally, the further comprises measuring a level of a pressureapplied during the touch gesture, the identifying being performedaccording to the combination and the level.

Optionally, the method further comprises detecting a direction of thestroke, the identifying being performed according to the combination andthe direction.

Optionally, the automatically selecting comprises automaticallyselecting one of the plurality of characters and a plurality of commandsfor executed by the computing unit.

Optionally, the plurality of characters comprises alphabetic characters,digits, punctuations, and mathematical operations.

Optionally, the computing unit is selected from a group consisting of: acellular phone, a phone, a remote control, an electric book, a gameconsole, a camera, a laser pointer, a navigation system, a videorecorder, a music player, and an audio recorder.

Optionally, the identifying comprises identifying a combination of theshape, the relative position, and at least one member of a groupconsisting of a direction of the stroke, an interlude performed duringthe stroke an interlude performed during the stroke, a user inputreceived during the stroke, and a pressure applied during the stroke.

Optionally, plurality of characters comprises alphabetic characters of aplurality of languages.

Optionally, the method further comprises magnifying an editing areadisplayed in a presentation device, the character being imputed to theediting area.

According to some embodiments of the present invention there is provideda human user interface of allowing a user to input a character to acomputing unit. The human user interface comprises an input surface forcapturing a stroke drawn by a user in relation to a reference zone, anencoder for encoding a shape and a relative position of the stroke inrelation to the reference zone, a stroke recognition module forautomatically identifying a character of a plurality of charactersaccording to the shape and relative position, and an outputtinginterface for outputting the character.

Optionally, the human user interface further comprises a memory forhosting a plurality of stroke specifications, at least one of theplurality of stroke specifications being indicative of one of theplurality of characters, the automatically identifying comprisesidentifying a unique combination of the shape and the relative positionand selecting the character by identifying a match between the uniquecombination and one of the plurality of stroke specifications.

More optionally, at least one of the plurality of stroke specificationsis indicative of a word, the stroke recognition module being configuredfor selecting the word by identifying a match between the uniquecombination and one of the plurality of stroke specifications.

Optionally, the input surface is a click wheel and the reference zonebeing a circle, the circle and the click wheel being concentric.

Optionally, the stroke is performed by a pointing element of a groupconsisting of: a finger, a stylus, and a laser marker.

More optionally, the input surface is configured for capturing thestroke by detecting a continuous touch gesture of the pointing element,each the character being a different character of a natural languagealphabet.

Optionally, the input surface is configured for displaying the referencezone thereon.

More optionally, the input surface is configured for displaying a menuin the reference zone, the stroke recognition module being configuredfor navigating in the menu according to the stroke.

More optionally, the menu is a sub menu of a hierarchical menu, thestroke recognition module being configured for navigating in the menuhierarchical menu and respectively instructing a display of a pluralitysub menus according to the stroke.

More optionally, the stroke is performed by at least one of a click anda touch gesture.

Optionally, the reference zone is circular.

Optionally, the reference zone is rendered on the input surface.

Optionally, the user interface is configured to allow the user toreposition the reference zone in relation to the orientation thereof.

More optionally, the input surface is configured for capturing at leastone of an additional stroke and a click, the stroke recognition modulebeing configured to adjust the character according to the at least oneadditional stroke and click.

Optionally, the device is integrated into a handheld device, thecharacter being used as a user input of an application executed by thehandheld device.

Optionally, the outputting interface is wireless interface configured toforward the character to an external device.

Optionally, the first and second of the plurality of strokespecifications are respectively indicative of a lower case form and anupper case form of an alphabetic character, the first strokespecification being matched with a first stroke having a first outlineand the second stroke specification being matched with a second strokehaving a second stroke, the second stroke comprises the first stroke.

Optionally, the human user interface further comprises a user interfacemodule for allowing a user to associate at least one of the plurality ofstroke specifications with a member of a group consisting of acharacter, a command, a digit, and a paragraph, the stroke recognitionmodule being configured for selecting the member by identifying a matchbetween the unique combination and the at least one strokespecification, the outputting interface being configured for outputtingthe member.

Optionally, the input surface is attached on a man machine interfacedevice.

Optionally, the human user interface further comprises a curser moduleconfigured for moving a curser according to the stroke.

Optionally, the input surface is configured for displaying a pluralityof reference zones and capturing a plurality of strokes each separatelyperformed in relation to one of the plurality of reference zones, thestroke recognition module being configured for separately performing theidentifying and selecting for each the separately performed stroke so asto allow the outputting interface to output a plurality of characters toat least one application accordingly.

Optionally, the human user interface further comprises a housing havinga width of less than 5 millimeters for supporting the input surface, theencoder, and the stroke recognition module.

More optionally, the housing is attached to a surface of a device, theoutputting interface configured for outputting the character as input tothe device.

Optionally, the input surface is mounted on top of at least one of agear stick and a steering wheel and the outputting interface beingconfigured for outputting the character to a vehicle system.

According to some embodiments of the present invention there is provideda method of inputting a character. The method comprises capturing astroke drawn by a user and outline a form of a character in combinationwith an outline of a circular reference zone, computing the characteraccording to a of the stroke in relation to the circular reference zone,and outputting the character as an input of the user.

Optionally, at least one of the form and the reference zone is mnemonicfor the character.

According to some embodiments of the present invention there is provideda human user interface of allowing a user to input a character to acomputing unit. The human user interface comprises a reference spotsensor for measuring a finger gesture performed in relation to areference spot, a finger holding element for mounting the sensor on afinger of a user, an encoder for encoding a shape and a relativeposition of the finger gesture in relation to the reference spot, andstroke recognition module for automatically identifying a characteraccording to the shape and the relative position.

Optionally, the stroke recognition module is hosted on a computing unitand configured for forwarding the character thereto, further comprisesan outputting interface for transmitting the shape and the relativeposition to the stroke recognition module.

Optionally, the reference spot sensor comprises at least one imagesensor for capturing an image and using one of the image and a portionof the image as the reference spot.

According to some embodiments of the present invention there is provideda human user interface of allowing a user to input a character to acomputing unit. The human user interface comprises a touch screen forpresenting a menu on a reference zone and for capturing a plurality ofstrokes drawn by a user, each the stroke being performed in relation tothe reference zone and a stroke recognition module for automaticallyidentifying a character of a plurality of characters and navigating inthe menu, each one of the identifying and navigating being performedaccording to a different stroke of the plurality of strokes.

Optionally, each the stroke is a performed by a continuous touch gestureon the touch screen.

Optionally, the stroke recognition module is configured for selectingmenu items of the menu according to the plurality of strokes.

More optionally, each the stroke is performed as a discrete andcontinuous touch gesture performed on the touch screen, the strokerecognition module being configured for navigating among a plurality ofsub menus according to the stroke.

Unless otherwise defined, all technical and/or scientific terms usedherein have the same meaning as commonly understood by one of ordinaryskill in the art to which the invention pertains. Although methods andmaterials similar or equivalent to those described herein can be used inthe practice or testing of embodiments of the invention, exemplarymethods and/or materials are described below. In case of conflict, thepatent specification, including definitions, will control. In addition,the materials, methods, and examples are illustrative only and are notintended to be necessarily limiting.

Implementation of the method and/or system of embodiments of theinvention can involve performing or completing selected tasks manually,automatically, or a combination thereof. Moreover, according to actualinstrumentation and equipment of embodiments of the method and/or systemof the invention, several selected tasks could be implemented byhardware, by software or by firmware or by a combination thereof usingan operating system.

For example, hardware for performing selected tasks according toembodiments of the invention could be implemented as a chip or acircuit. As software, selected tasks according to embodiments of theinvention could be implemented as a plurality of software instructionsbeing executed by a computer using any suitable operating system. In anexemplary embodiment of the invention, one or more tasks according toexemplary embodiments of method and/or system as described herein areperformed by a data processor, such as a computing platform forexecuting a plurality of instructions. Optionally, the data processorincludes a volitile memory for storing instructions and/or data and/or anon-volatile storage, for example, a magnetic hard-disk and/or removablemedia, for storing instructions and/or data. Optionally, a networkconnection is provided as well. A display and/or a user input devicesuch as a keyboard or mouse are optionally provided as well.

BRIEF DESCRIPTION OF THE DRAWINGS

Some embodiments of the invention are herein described, by way ofexample only, with reference to the accompanying drawings. With specificreference now to the drawings in detail, it is stressed that theparticulars shown are by way of example and for purposes of illustrativediscussion of embodiments of the invention. In this regard, thedescription taken with the drawings makes apparent to those skilled inthe art how embodiments of the invention may be practiced.

In the drawings:

FIG. 1 is a schematic illustration of a human user interface ofconverting one or more strokes to a character and/or a command based ona shape formed by the strokes and the position of the shape relative toa reference zone, according to some embodiments of the presentinvention;

FIG. 2 is a schematic illustration of set of stroke specificationsassociated with English alphabetic characters, according to someembodiments of the present invention;

FIG. 3 is a schematic illustration of set of pairs of strokespecifications, each pair associated with a different alphabeticcharacter, according to some embodiments of the present invention;

FIG. 4 is a schematic illustration of exemplary shapes if a referencezone according to some embodiments of the present invention;

FIG. 5 is a schematic illustration of a method of converting a stroke toa character or a command, based on a combination formed by its shape andits position thereof in relation to a reference zone, such as theaforementioned reference zone, according to some embodiments of thepresent invention;

FIG. 6 is a schematic illustration of a set of pairs of strokespecifications, each associated with a common digit, according to someembodiments of the present invention;

FIG. 7 is a schematic illustration of a set of stroke specificationswhich are associated with editing commands, according to someembodiments of the present invention;

FIG. 8 is a schematic illustration of a set of stroke specificationswhich are associated with notations, punctuations, and mathematicaloperations, according to some embodiments of the present invention;

FIG. 9 depicts a schematic illustration of a stroke specification of auser stroke comprising sequential sub strokes with opposing directionsand indicative of two or three repetitive alphabetic characters,according to some embodiments of the present invention;

FIG. 10 depicts a C-shaped stroke that is performed on the boundaries ofa circular reference zone and a curved stroke that is ended on the topof the circular reference zone, both ended with an interlude, accordingto some embodiments of the present invention;

FIG. 11 is a schematic illustration of a stroke specification associatedwith a word, according to some embodiments of the present invention;

FIG. 12A is a schematic illustration of a set of Hebrew alphabeticcharacters which are associated with a number of stroke specifications,according to some embodiments of the present invention;

FIG. 12B is a schematic illustration of a set of Hebrew punctuations,according to some embodiments of the present invention;

FIG. 13 is a schematic illustration of a finger gripping device,according to some embodiments of the present invention;

FIG. 14 is a schematic illustration of a reference zone that is used forcontrolling a command menu, according to some embodiments of the presentinvention;

FIG. 15 is a schematic illustration of a reference zone that is used forcontrolling a command menu by strokes, according to some embodiments ofthe present invention;

FIG. 16 is a schematic illustration of a reference zone that is used forcontrolling a hierarchical menu, according to some embodiments of thepresent invention; and

FIG. 17 is a schematic illustration of a reference zone that is used forcontrolling a hierarchical menu by strokes, according to someembodiments of the present invention.

DESCRIPTION OF EMBODIMENTS OF THE INVENTION

The present invention, in some embodiments thereof, relates to methodand system for user interface and, more particularly, but notexclusively, to a method and system for user interface based on strokes.

According to some embodiments of the present invention, there isprovided a method and a human user interface for converting a stroke,optionally performed as a touch gesture on an input surface, such as ascreen touch, to a character according to the shape of the stroke andthe relative position thereof in relation to a reference zone,optionally circular. Optionally, strokes are converted to alphabeticcharacters, digits, notations, punctuations and/or commands. The humanuser interface may be used for operating an electric device, such as acellular phone, music player, a remote control, an electric book, a gameconsole, a digital camera, a remote control and the like, and/or forinputting characters thereto.

Optionally, the human user interface allows the user to input anyalphabetic character of a natural language alphabet, such as Latinalphabet, with a single continuous touch gesture, optionally withoutmoving her wrist. Optionally, the human user interface allows the userto her finger, for example her thumb, for performing the stroke.

Optionally, the different characters may be distinguished by thedirection of the stroke, the pressure the user applies during whilestroking, an input received from another user interface, such as abutton, and/or another stroke and/or a click on the input surface of thedevice.

According to some embodiments of the present invention, there isprovided a method of converting a user stroke to a character accordingto a mnemonic form it creates when combined with an outline of acircular reference zone, such as a circle. The method is based oncapturing a user stroke that outlines a form of an alphabetic characterwhen combined with an outline of the circular reference zone. The formedalphabetic character is computed according to the shape of the strokeand the relative position of the shape in relation to the circularreference zone. Such a computation allows outputting the character as aninput of the user to an electric device and/or a computing unit.

According to some embodiments of the present invention there is provideda finger gripping device for converting finger gestures to charactersaccording to a shape it forms and the position of the shape in relationto a reference spot.

According to some embodiments of the present invention there is provideda human user interface having a touch screen that allows user to inputcharacters and navigating menus by touch gestures, optionally discreteand continuous. The touch screen displays a reference zone, such as acircle, and captures strokes which are indicative of characters whencombined with the reference zone. Furthermore, the touch screen displaysa menu on the reference zone and captures touch gestures which areindicative of menu navigation and/or selection actions. Optionally, thetouch gestures are performed by a single finger, optionally the thumb.Optionally, the menu is hierarchical and the navigation is among submenus. Optionally, a single continuous touch gesture is used fornavigating among a plurality of sub menus.

Before explaining at least one embodiment of the invention in detail, itis to be understood that the invention is not necessarily limited in itsapplication to the details of construction and the arrangement of thecomponents and/or methods set forth in the following description and/orillustrated in the drawings and/or the Examples. The invention iscapable of other embodiments or of being practiced or carried out invarious ways.

Reference is also made to FIG. 1, which is a schematic illustration of ahuman user interface 200 of converting a stroke of a pointing element,such as a finger or a stylus, to a character and/or a command based on ashape formed by the stroking of the pointing element and the relativeposition of the shape in relation to a reference zone that is optionallydisplayed on an input surface 201, according to some embodiments of thepresent invention.

For clarity, the stroke is created by a touch gesture of a pointingelement, such as a tip of a finger, a stylus, and/or a writing element,for example a pen or a pencil, on top of a input surface 201 or inproximity thereto. The stroke is performed in relation to a referencezone, such a circle an ellipse, which is presented on the input surface.Optionally, the stroke is a continuous touch gesture of the pointingelement on the input surface. A single slide stroke may be representedas a continuous line, optionally curved. In such an embodiment, thehuman user interface 200 allows the user to input characters, such asalphabetic characters and digits using a single finger, optionally herthumb. In such a manner, the human user interface 200 may use an inputsurface, such a touch screen or touch pad, to present the reference zoneand allow the user to slide her thumb for typing all the alphabeticcharacters and digits of a natural language alphabet, such as Latinalphabet, without moving other fingers and/or the wrist. Additionally oralternatively, the user may use two fingers for substantiallysimultaneously, or simultaneously, inputting a number of characters. Insuch an embodiment, the input surface 201 captures two strokes which areseparated and converted to characters according to their stating points,shape and/or relative position. In such an embodiment, the charactersmay be inputted faster.

As outlined above, the human user interface includes input surface 201for separately capturing and/or recording strokes which are performed bya human user. For example, the input surface 201 may be an input pad,touch panel, a touch screen, such as a liquid crystal display (LCD)screen with an integrated touchpad, a multifunctional touch button, amultifunctional pushbutton, a scroll wheel, and a selection device basedon a combination of a button and a scroll wheel, also known as a clickwheel, for instance as used in the IPod™ device, see IPod Classic™device, which the specification thereof is incorporated herein byreference, an optical coordinate input detection device, and a surfacehaving one or more optical sensors, such as complementary metal oxidesemiconductor (CMOS) based or charge coupled device (CCD) based sensors,for capturing strokes which are performed by a human user. Optionally,the input surface 201 is a click wheel and the reference zone is acircle which is concentric thereto. In such a manner, a click wheel isused for both character inputs, for example as described below, and forfiles and/or applications navigation, selection and/or operation. Theinput surface 201 is connected to an encoder 205 that encodes the shapeof the stroke and the relative position of the stroke in relation to thereference zone.

According to some embodiments of the present invention, the referencezone is a virtual shape that is presented on an input surface, such as atouch screen. In such an embodiment, the virtual shape may be dragged tovarious locations on the touch screen, allowing the user to assign anarea of the touch screen as an active area for inputting characters. Itshould be noted that by changing the location of the reference zonechanges the relative position coordinates. In such an embodiment, thereference zone may be in any location of the touch screen.

The human user interface further includes memory storage 202 for hostinga plurality of stroke specification records. For brevity, each one ofthe stroke specification records and/or a group of the strokespecification records may be referred to herein as a strokespecification. Each one of the stroke specifications defines a uniquecombination of a stroke shape and a stroke relative position in relationto the reference zone. Optionally, the relative position is between theinitial stroking point and the center of the reference zone. Optionally,the relative position is between the geometric center of the strokeshape and the center of the reference zone.

Some or all of the stroke specifications are associated with alphabeticcharacters, optionally of a natural language alphabet, such as Latinalphabet, Cumaean alphabet, Hebrew alphabet, and Arabic alphabet.Different strokes are separately associated with one of the alphabeticcharacters. In such an embodiment, the number of the strokespecifications is at least as the number of alphabetic characters of therespective alphabet language. Additionally or alternatively, a strokespecification may be associated with a command, such as an editingand/or an operation command, for example as described below.

Reference is now also made to FIG. 2, which is a schematic illustrationof set of stroke specifications 300 associated with English alphabeticcharacters, according to some embodiments of the present invention. Theshape and the position parameters of each exemplary stroke specificationare illustrated relatively to an exemplary reference zone, a circle.Each member of the set of stroke specifications 300 defines a uniquecombination of a stroke shape and a relative position in relation to thecircle, for example as shown at 301, which is a schematic illustrationof a stroke specification that is associate with the alphabeticcharacter b 302. In the set depicted in FIG. 2, the reference zone is acircle 303 marked by a dashed line. The stroke position and shape aredepicted by a bold line, for example as shown at 304. As shown at 304and 306, strokes with similar shapes may be used in different strokespecifications as long as their relative position in relation toposition of the reference zone 303 is different.

As depicted in FIG. 1, the human user interface 200 further includes astroke recognition module 203 for identifying a match between the shapeand the position of a stroke, which is captured by the input surface andencoded by the encoder 205 and one of the stroke specifications. Thematch allows the stroke recognition module 203 to pick, from the storage202, the character or the command with which the matched strokerecognition module 203 is associated, or a value that represents thecharacter or the command, and to forward it to an output interface 204,such as a character generator. The output interface 204 forwards thecharacter, for example the alphabetic character, as an input to anapplication which is executed on a device hosting or integrating thehuman user interface 200, to an electronic device and/or a computingunit that is connected to the human user interface 200, and/or to adisplay unit, such as to the input surface 201 that is optionally atouch screen. Optionally, the character triggers the execution of acommand. Optionally, stroke recognition module 203 ignores outputs ofthe input surface for a short period after a stroke is detected. In sucha manner, the stroke recognition module 203 may separate betweensequential strokes which are indicative of different characters, such asalphabetic characters or numbers, and/or commands.

Optionally, each member of a set of stroke specifications defines astroke based on a continuous touch gesture. Optionally, some or all ofthese stroke specifications define a sequence of strokes, for example asdepicted in FIG. 3, stroke specifications which are associated with thecharacters t, f and k. In such an embodiment, the shape parameter isbased on the shape that is formed by the composition of the strokes andthe relative position parameter is the position of the first stroke, thesecond stroke, the combination of strokes and/or a meeting point betweenthe strokes.

According to some embodiments of the present invention, a combinationbetween the stroke and the reference zone depicts, or substantiallydepicts, the character with which the related single strokespecification is associated. For example, a straight stroke that startsapproximately at the leftmost corner of a circular reference zone andpulled downwards depict, when considered together with the referencezone, the alphabetic character P. Such a stroke is optionally associatedwith the character P.

According to some embodiments of the present invention, the referencezone is circular, for example as shown at FIG. 2 and FIG. 3. Optionally,the reference zone is a circle. Such a reference zone is specificallyuseful for certain natural language alphabets, such as Latin and Hebrew.In these alphabets, many alphabetic characters comprise circularelements and/or semi circular elements. For example, most of thelowercase English alphabetic characters include circular elements, forexample a, b, d, e, g, o, q, and p or semi circular elements, forexample c, h, m, n, s. w, and y. This phenomena allows outlining thevast majority of the alphabetic characters by a touch gesture of asingle slide stroke toward and/or from the circular reference zone or bystroke based on a continuous touch gesture on a portion of the circularreference zone, for example as shown at FIG. 2. Therefore, thecircularity of the reference zone is mnemonic to remember the strokes,or the form of the strokes in combination therewith, which areindicative of alphabetic characters and makes the alphabetic characterinput process intuitive to an individual. In particular, when thereference zone is a circle, the individual mostly has only to figure outhow to outline the form of the alphabetic character she wants to inputby drawing a stroke in proximity to the reference zone in a manner theyjointly depict the alphabetic character and not to recall which strokeis associated with this alphabetic character. Thus, learning how to usesuch a human user interface 200 does not require memorizing for eachalphabetic character a new shape and/or a new stroke but ratherimplementing a simple and intuitive modus operandi in which theboundaries of the reference zone are part of the outlines of therequested alphabetic character and/or comprises outlines of therequested alphabetic character. In such an embodiment, as thecombination of the circle and the stroke outlines an alphabeticcharacter, the size of the circle is indicative of the length of thestrokes and size and/or curves of the strokes shape and vise versa.Therefore, the visibility of the circle allows the user to betterestimate the length of the stroke she has to slide in order to input acertain word. Optionally, the size of the reference zone is dynamicallyadjusted according to the length of one or more strokes. For example, ifthe length of the strokes is estimated to be longer than expected inorder to outline a character, the reference zone is enlarged and if thelength of the strokes is estimated to be shorter than expected, thereference zone is respectively minimized. Optionally, the length:heightratio of the reference zone is 1:1, 3:4, 4:3. Optionally, the referencezone is fixated on the input surface 201. Optionally, the reference zoneis projected in relation to the surface of the input surface 201.

Optionally, the reference zone is semi transparent. In such a manner,the reference zone may be presented, for example rendered, on top of agraphical user interface and/or a display that is presented on thescreen of a device integrating the human user interface 200. Forexample, the reference zone is superimposed on top of a webpage that isdisplayed on browser hosted by a cellular phone that integrates thehuman user interface 200.

Optionally, the reference zone is hidden when inactivated for a certainperiod.

It should be noted that the reference zone may have other shapes, forexample a star shape, a dot shape, or a rectangular shape, for exampleas depicted in FIG. 4.

It should be noted that as the human interface human user interface 200is designed to intercept strokes which are analyzed according to theirposition relative to the reference zone, mix ups pertaining to theorientation of the stroke relative to the orientation of the inputsurface are avoided. Optionally, the reference zone may be repositioned,for example rotated, manually or automatically, toward different edgesof the input surface, allowing a user to slide the pointing element fromdifferent directions. In such a manner, the user does not have toconsider the orientation of the input surface before performing a strokeusing the pointing element. Optionally, the reference zone isautomatically aligned with the orientation of the input surface, forexample according to outputs of an accelerometer and/or a gyroscope thatis attached to the human user interface.

Reference is now also made to FIG. 5, which is a schematic illustrationof a method 100 of converting a stroke, optionally a single slidestroke, to a character or to a command, based on its shape and on itsposition thereof in relation to a reference zone, such as theaforementioned reference zone, according to some embodiments of thepresent invention.

First, as shown at 101, a stroke of a user is recorded, for exampleusing the aforementioned input surface or a finger gripping device, suchas described below. Optionally, the recorded data is represented as avector or a matrix of coordinates of the stroke.

As described above, the unique combination between the shape and therelative position of the stroke is indicative of a certain character ora command that is provided by the user.

As shown at 102, this certain character or command is decoded byidentifying a match between the unique combination and one of the strokespecifications. For example, the current shape and position may bematched with the stroke specifications which are stored in storage 202.The matching allows picking a character that is associated with thematched stroke specification so as to convert the single slide strokewhich is performed by the user to an input of a conforming character.

Blocks 151-154 depict an exemplary process of identifying a matchingstroke specification. First, as shown at 151, stroke specifications arefiltered according to the starting point of the stroke. As the strokespecification includes a relative position in relation to the referencezone, the filtering may be performed with low computational complexity.In such an embodiment, each stroke specification indicates a relatedstarting point and or an area in which the starting point should appear.The size and/or shape of this area may be separately defined for eachstroke specification, for example based on accumulated statistical dataand/or collectively defined to some or all of the stroke specifications.Now, as shown at 152, the movement of the recorded stroke is computed.As shown in 153, this allows further filtering the potential strokespecifications according to shape and optionally direction, interludes,sliding paces, repetitions and the like, for example as described below.As shown at 154, this process is optionally repeated for segments of thestrokes. In such a manner, when only one stroke specification is left,the character or the command which is associated therewith is identifiedand outputted as the character or command inputted by the user.

It should be noted that as the computational complexity of the a processis limited, particularly when the number of stroke specifications isless than 50, for example when stroke specifications represent only thealphabetic characters and digits of a certain natural language alphabet.In such a manner, the method 100 may be implemented by a centralprocessing unit (CPU) or a microprocessor with limited computationalpower and/or low power system on chip (SOC) that integrates all thecomponents depicted in FIG. 1 into a single integrated circuit (IC).

Now, based on the matching stroke specification, as shown at 103, acommand or a character is identified, for example according to thecommand or the character that is associated therewith.

Optionally, as shown at 104, the outputted character or command isadjusted according to an additional user interface input parameter, forexample a simultaneous pressure that is applied on the input surface,for example using another pointing element, such as a finger and/or asimultaneous press on a certain key, for example SHIFT and “adjustvolume” in a human user interface that is integrated into a phones. Forexample, if the certain key is pressed and the character is analphabetic character, then the identified character is inputted in anupper case form, else the identified character is inputted in lower caseform. Optionally, the outputted character or command is adjustedaccording to the level of pressure that is applied during the stroke onthe input surface. For example, if the applied pressure is above acertain level and the character is an alphabetic character, then theidentified character is inputted in an upper case form, else theidentified character is inputted in lower case form.

Optionally, the outputted character or command is adjusted according toperiod the user holds the pointing element before and/or after the touchgesture of the stroke. For example, if the stroke is hold for more thana certain period, for example 2 seconds, and the character is analphabetic character, then the identified character is inputted in anupper case form, else the identified character is inputted in lower caseform.

As shown at 105, the character is presented, forwarded to an electricdevice and/or a computing unit forwarded to otherwise transferred, forexample as described above. For example, the character is an alphabeticcharacter that is displayed on the screen of a device using the humanuser interface 200, such as a cellular phone, and input the alphabeticcharacter to a hosted application, such as an SMS writer.

As shown at 106, the process may be sequentially repeated in a pluralityof iterations so as to allow user to input a plurality of alphabeticcharacters, digits, and/or commands in a raw. Optionally, an interludeis taking between the iterations. Optionally, an interlude sign ispresented to the user, for example by diming the reference zone.Optionally, the size or the location of the reference zone isdynamically changed according to the length and/or starting points ofthe strokes.

According to some embodiments of the present invention, the strokespecifications are used for decrypting a message encrypted by userstrokes. In such an embodiment, a message or a password may be encryptedby a set of strokes which is later decrypted to create a set ofcharacters and/or commands.

According to some embodiments of the present invention, a number ofstroke specifications, each defining a different unique combination ofshape and relative position, are associated with a common character, forexample as shown at FIG. 3. In such an embodiment, while one strokespecification is associated with a first representation of a certaincharacter, for example a lower case representation, a different strokespecification is associated with a second representation of the certaincharacter, for example an upper case representation.

Optionally, the shape of a certain one stroke specification is part of ashape of another stroke specification. For example, as depicted in FIG.3, one representation associated with the alphabetic character Iincludes a dot and a straight line, aligned on a bisector that dividesthe reference zone to left and right sides, and another representationof the alphabetic character I includes only the dot in a correspondinglocation on the bisector. For clarity, the pointing element creates adot by clicking on the input surface 201.

It should be noted that as the reference zone constitutes a part of theoutline of the requested word, the length of a stroke that is visuallyindicative of a requested alphabetic character, and therefore the timeand effort it takes to create the stroke, is reduced.

According to some embodiments of the present invention, the relativeposition and shape of the current user stroke is matched with strokespecifications which are associated with digits, for example as shown inFIG. 6 that describes pairs of stroke specifications, each associatedwith a common digit.

According to some embodiments of the present invention, the position andshape of the current user stroke is matched with stroke specificationswhich are associated with editing commands, such as space, enter, anddelete (del), for example as shown in FIG. 7. For clarity, a singleslide stroke that is based on clicking, for example placing a pointingelement for a short duration, for example less than one 2 second, lessthan one second, and less than half a second, is depicted in the figuresas a dot, for example as shown at 501. A single slide stroke that isbased on placing a pointing element for a longer duration, for examplemore than one 2 second, more than one second, and more than half asecond, is depicted in the figures as an empty circle, for example asshown at 502.

According to some embodiments of the present invention, the position andshape of the current user stroke is matched with stroke specificationswhich are associated with notations, such as slash, punctuations, suchas colon and/or mathematical operations, such as minus and plus, forexample as shown in FIG. 8.

According to some embodiments of the present invention, one or more ofthe stroke specifications define a unique combination of shape andrelative position parameters, for example as described above, with astroke direction parameter. In such an embodiment, strokes having anidentical shape and relative position may have a different and/or acumulative meaning if they are performed in opposing directions. Forexample, FIG. 9 depicts a stroke specification of a user stroke with iscomprised of sequential sub strokes with opposing directions andindicative of two or three repetitive alphabetic characters.

Optionally, the stroke specifications includes a first group whereineach member is associated with a lower case of a certain alphabeticcharacter and defines a unique combination of shape, position, anddirection stroke parameters and a second group wherein each memberrespectively associated with an upper case of the certain alphabeticcharacter and defines a combination of shape and relative positionparameters that is similar to a respective combination of one of themembers of the first group and an opposing direction stroke parameter.For example, while a first stroke specification is associated with alower case representation of the alphabetic character “C” and defines ac-shaped stroke that is performed from bottom to top above the leftsemicircle of a circular reference zone a second stroke specification isassociated with the upper case representation of the alphabeticcharacter “C” and defines a c-shaped stroke that is performed from topto bottom on the same left semicircle.

Optionally, the stroke specifications are associated with systemcommands, for example Copy, Paste, Caps Lock and Cut and/or editingcommands, for example Bold, Italic and the like.

According to some embodiments of the present invention, one or more ofthe stroke specifications define a unique combination of shape andrelative position parameters, for example as described above, with apressure level parameter. In such an embodiment, the pressure that isapplied during the stroke of the user may change the selected strokespecification.

According to some embodiments of the present invention, one or more ofthe stroke specifications define a unique combination of shape andrelative position parameters, for example as described above, with anadditional user interface input parameter. In such an embodiment, if theuser makes a selection and/or presses on a certain key, for exampleSHIFT and “adjust volume” in a human user interface that is integratedinto a phones, than the selected stroke specification may be changed.Optionally, the additional user interface input is a simultaneous clickon the top of the input surface.

According to some embodiments of the present invention, one or more ofthe stroke specifications define an interlude performed during and/orjust after the stroke. For example, FIG. 10 depicts a C-shaped strokethat is performed on the boundaries of a circular reference zone andcurved stroke that is ended on the top of the circular reference zone,both ended with an interlude in which the pointing element is maintainedfor a period, for example for 2-3 seconds, according to some embodimentsof the present invention. In the exemplary stroke specification depictedin FIG. 9, the interludes differentiate between a C-shaped stroke andS-shaped stroke which are performed on the boundaries of the a circularreference zone and respectively indicative of the alphabetic character Cand S and similar C-shaped and S-shaped strokes which are respectivelyindicative of the command COPY and SAVE.

According to some embodiments of the present invention, one or more ofthe stroke specifications define specific words, for example as depictedin FIG. 11, for example common words, optionally selected according todynamic statistical analysis of usage patterns recorded by the humanuser interface 200, a central server collecting data from a group ofhuman user interface 200, optionally via a computer network, such as theinternet. In other embodiments, the data is static and provided inadvance, and/or when updating the human user interface 200.

According to some embodiments of the present invention, the user assignscustom strokes to different characters, words, and/or commands. In suchembodiments, the human user interface presents a graphical userinterface (GUI) that allows the user to create a custom strokespecification with unique combination of stroke shape and relativeposition, optionally with an interlude, repatriation, and/or adirection, and to associate the created stroke specification with acharacter, a word, or a command. For example, a user may create a strokespecification with a unique combination and associate the uniquecombination with a command triggering an operation related to a deviceusing the human user interface 200. For example, if the device is acellular phone and/or a tablet, the unique combination may be associatedwith a lock touchpad screen operation, power off operation, volumecontrol operation, and the like.

As described above, some embodiments of the invention allows a user toinput alphabetic characters of one or more different natural languagealphabets. FIG. 12A describes a set of Hebrew alphabetic characterswhich are associated with a number of stroke specifications that defineunique combinations of shape and relative position, according to someembodiments of the present invention. Similarly to FIG. 3, eachalphabetic character is associated with two stroke specifications.

Optionally, the human user interface 200 is designed to receivealphabetic characters of a certain natural language alphabet at thetime. In such a manner, a predefined clicking or sliding may be used forchanging the natural language alphabet. Optionally, the human userinterface 200 allows the user to input alphabetic character of two ormore natural language alphabets without indicating a language swap. Insuch an embodiment, similar strokes may be differentiated according tothe direction of the slide, the previously inputted alphabeticcharacters and/or creating two or more sets of alphabetic characters,each of a different natural language alphabet, so that each alphabeticcharacter of any of the sets is associated with a different uniquecombination.

As described above, the reference zone may be presented on the inputsurface. In such an embodiment, the space bounded by the reference zone,and optionally an additional space that encircles the reference zone,functions as a touchpad. In use, the user slides her finger over thereference zone to move a curser that is displayed on the input surface,for example using mouse like movements. Optionally, one of the strokespecifications is associated with a command that activates and/ordeactivate the reference zone as a touchpad. Optionally, the human userinterface 200 includes a curser module, which is similar to knowntouchpad modules, for converting the strokes of the user to cursercontrol commands.

According to some embodiments of the present invention, two referencezones are presented the input surface and/or each on a different inputsurface. In such an embodiment, the user may use both his hands forinputting alphabetic characters, digits, and/or commands. For example,the two reference zones are presented so as to allow the user to slide,simultaneously, or substantially simultaneously, his thumbs on inproximity or over the reference zones. In such an embodiment, alphabeticcharacters may inputted by a combination of strokes which are inputtedsimultaneously, or substantially simultaneously, in relation to the tworeference zones.

As described above, the stroke may be performed by a user's finger, astylus, a pen, and/or any other pointing device. Optionally, the inputsurface is adjusted, dynamically or statically, according to theproperties of the used pointing device, for example the width if the tipof the pointing element. Optionally, the estimated pressure level,conductive coupling level, and the like are also adjusted according tothe estimated pointing element.

According to some embodiments of the present invention, alphabeticcharacters and/or numbers inputted using the aforementioned deviceand/or method are forwarded to a predictive text module. The predictivetext module estimates complementary alphabetic characters and/or numbersaccording to a dictionary. The complementary alphabetic characters areselected to complete words estimated to match the intention of the user.The predictive text module optionally functions based on commonly knownalgorithms, for example T9™ algorithm, which the specification thereofis incorporated herein by reference. The combination of the predictivetext allows the user to input serially words with fewer strokes.

According to some embodiments of the present invention, alphabeticcharacters and/or numbers inputted using the aforementioned human userinterface 200 and/or method are forwarded to a spellchecking module. Thespellchecking module suggests corrections to words which are compiledfrom alphabetic characters and/or numbers which are inputted using theaforementioned human user interface 200 and/or method, for example asdescribed above.

According to some embodiments of the present invention, alphabeticcharacters and/or numbers inputted using the aforementioned deviceand/or method are forwarded to a search module. The alphabeticcharacters and/or numbers are optionally sent in real time, while thepointing element generates additional strokes. The search modulesearches a local database and/or one or more indexes which are based onone or more databases which are accessible by the human user interface200. In such an embodiment, the user dynamically refines search resultswhile sliding the pointing element over the input surface, making newuser strokes.

According to some embodiments of the present invention, a plurality ofreference zones are displayed on an input surface, such as aninteractive table, for example Microsoft Surface™. In such anembodiment, a plurality of users can simultaneously input charactersand/or commands to a single input surface. Optionally, the referencezones may be dragged and dropped in various locations along the inputsurface. In such a manner, the users are not forced to enter data in acertain segment of the input surface. Optionally, different referencezones are assigned to different applications, allowing the user to inputsimultaneously, or substantially simultaneously, characters and/orcommands to different applications.

According to some embodiments of the present invention, the size of thereference zone is adjustable. In such an embodiment, the strokespecifications are adjusted to fit the size of the reference zone. Forexample, the stroke shape and relative position of each strokespecification are adjusted to fit the new dimensions of the referencezone. Optionally, a large reference zone, such as a circle having aradius of 4 cm or more, is selected for children and/or visuallyimpaired users. In another embodiment, a small reference zone, such as acircle having a radius of 2 centimeters or less, is selected in order toavoid concealing applications which are presented on the input surfacesand/or to fit in touch displays with a limited size.

According to some embodiments of the present invention, the region thatis bound by the outline of the reference zone is used as a magnifierthat magnifies an area in proximity to a curser that is displayed on adevice controlled by the human user interface 200. For example, if thehuman user interface 200 is used for inputting characters to a computingunit, such as a laptop or a Smartphone, the area in proximity to thecurser that is displayed on the screen of these devices is enlarged.Such a magnification allows the user to see exactly the selection areaof a curser. In such a manner, the user can edit words without having toenlarge text segments which are displayed on the screen of thecontrolled device. Optionally, a number of reference zones are presentedsimultaneously and separately magnifying sequential areas of thedisplay, for example the area that is parallel to the display from theleft and the right sides of the cursor. Optionally, the magnifyingallows the user to select and punctuate an alphabetic character. Forexample, FIG. 12B depicts various Hebrew punctuations.

According to some embodiments of the present invention, the human userinterface 200 is used as a user interface of electric articles, such ascameras, laser pointers, navigation systems, such as global positioningsystem (GPS) based systems, video recorders, music players, cellularphones, phones, audio recorders and/or any electric device having alimited size for user interfaces. The human user interface 200 may beintegrated as an independent unit that is integrated into the electricarticle instead or in addition to an existing user interface, such as akeypad, or provided as part of the electric article.

For example, when combined with landline phone and/or cellular phones,the human user interface may allow the user to provide a text for ashort message service (SMS), update and/or search a contact book, acalendar, an electric notebook, and/or any other application thatrequire character based operation.

According to some embodiments of the present invention, the human userinterface 200 is integrated into a man machine interface device, forexample a mouse, a joystick and/or a gaming console control unit, suchas a Wii™ Nunchuk controller, a Wii™ remote, an Xbox™ controller. Suchintegration enhances the input capabilities of the user interface. Forexample if the user interface is a mouse, the user may use the enhancedmouse for inputting alphabetic characters and/or controlling to objectsand/or application simultaneously, or substantially simultaneously.

According to some embodiments of the present invention, the human userinterface 200 is integrated a device to aid disabled to operate electricdevices, for example computers, wheelchairs, and/or any other device. Asthe human user interface 200 allows inputting data using strokes,disabled people with limited motoric abilities can use the device easilyrelatively to user interface that require more complex movements, suchas keyboards and the like.

According to some embodiments of the present invention, the human userinterface 200 is integrated into an augmented imaging and/or virtualreality system. In such an embodiment, the reference zone, and theinputted characters are displayed on the presentation unit of thesesystems, for example on a designated per of glasses and/or a designatedscreen. It should be noted that as the human user interface 200 isintuitive the user does not have to avert her gaze from the display ofthe augmented imaging and/or virtual reality system.

In another example, when combined with digital camera and/or videocamera, the human user interface 200 allows the user to providecharacters and/or commands for tagging photos, editing photo details,and/or controlling Camera Functions.

According to some embodiments of the present invention, the device isintegrated into a miniature electronic device, such as a miniaturecellular phone, for example as described in US Patent Application No.2009/0176528 and U.S. Pat. No. 7,509,094, which the content thereof isincluded herein by reference. Such an integration is adventurous as isdoes not require increasing the dimensions of the miniature electronicdevice, adding a keyboard or an external user interface thereto or thelike. Furthermore, as the human user interface 200 may be implemented ona touch screen of the miniature device, no buttons will be needed forallowing user to insert characters and/or commands with a single actionsuch as a stroke. The user does not have to mark a character from adisplayed set and/or to press a certain button a number of time only inorder to select an alphabetic character, for example as used with commoncellular phone keypads.

According to some embodiments of the present invention, the method 100is executed on a client terminal, such as a Smartphone, a music player,a laptop having a touchpad, and a computerized touch screen, for exampleas an add-on, such as a browser add-on.

Optionally, the method implemented on a server that is connected to anetwork. In such an embodiment, strokes may be recorded in clientterminals, which are connected to the network and forwarded, over thenetwork, to the server. This allows a user to use her client terminalfor recording strokes and forwarding the strokes as inputs to serversthat decode the strokes according to their shape and relative position.

According to some embodiments of the present invention, the human userinterface 200 is an independent device that interfaces with one or morecomputing devices, such as client terminals. Optionally, the outputinterface 204 includes a communication interface, such as a Bluetooth™interface and/or a Wi-Fi™ interface that forwards the characters and/orcommands to the one or more computing devices. In such an embodiment,the device is used as a remote control and/or a remote user interfacethat allows users to input characters and/or commands. Optionally, thehuman user interface 200 interfaces with a computer and used forinputting characters as a full QWERTY keyboard.

According to some embodiments of the present invention, the human userinterface 200 housed in a thin housing, optionally of less than 10 mmwidth, for example 2 mm wide. In such an embodiment, a thin inputsurface 201 is used. Optionally, the dimensions of such a device areless than 10 centimeters. In such an embodiment, the human userinterface 200 may be carried by the user, for example in her wallet, andused as a portable keyboard that may be connected to different computingunits and/or as a remote control which is adapted to control variousdevices. Such a thin human user interface 200 may be glued or otherwiseattached to fabrics, walls, metal surfaces, wood surfaces, and/or to anysurface. In such a manner, the human user interface may be used forcontrolling, remotely or locally, various devices.

According to some embodiments of the present invention, the human userinterface 200 is used for controlling vehicle systems, for examplenavigation systems, audio systems, and/or operation systems. Optionally,the human user interface 200 is attached to the top of a gear stickand/or a steering wheel, allowing the driver to input characters and/orcommands without removing her hand from the gear stick and/or thesteering wheel. It should be noted that such an inputting is facilitatedonly as the human user interface 200 allows using one or more fingers,such as the thumb, for inputting a large number of characters, such asalphabetic characters of one or more languages.

In some embodiments of the present invention, the human user interface200 forwards a signal that is indicative of the recorded strokes.Optionally, the stroke recognition, which is implemented by theaforementioned stroke recognition module 203, is performed by theinterfacing computing devices. In such an embodiment, the strokerecognition module 203 may be implemented on the interfacing computingdevices.

Optionally, the human user interface 200 is used as a learning remotecontrol that is used to control any number of pairing devices.Optionally, the human user interface is used to control devices with noother user interface, for example cameras, such as surveillance camerasand the like. Optionally, the human user interface is used as apresentation controller, TV remote control, set top box remote control,and the like.

Reference is now made to FIG. 13, which is a schematic illustration of afinger gripping device 900 of inputting characters and/or commands to acomputing unit, according to some embodiments of the present invention.The finger gripping device 900 includes a finger holding element 901,such as a ring, a thimble, or a finger protecting covering, such as aglove, for gripping a finger of a user. The finger holding element 901supports a reference spot sensor 902 for monitoring a finger gesturerelative to a reference spot. The finger holding element 901 furthersupports an encoder 903 that creates a slide signal indicating thefinger gesture in relation to the reference spot. The reference spotsensor 902 and encoder 903 may be separated components or integrated asa single component. Optionally, the reference spot sensor 902 includes anumber of sensors, each designed to detect a slant, a roll, and/or adeviation of the finger gripping device relative to the reference spot.For example, the reference spot sensor 902 includes a rotation sensorthat senses rotational movement of reference spot sensor 902 relative tothe reference spot a rotation encoder that causes a rotation signal tobe generated that indicates at least an extent to which the referencespot sensor 902 has been rotated relative to reference spot, and,optionally, a direction of such rotation.

Optionally, the finger gripping device 900 includes a communicationinterface 904, such as a Bluetooth™ interface and/or a Wi-Fi™ interface,forwards the signal to a computing unit that performs accordingly strokerecognition, for example similarly to the described above. The computingunit receives the slide signal and may now match the finger gesture withstroke specifications which are associated with a plurality ofcharacters and commands, for example similarly to the described above.The shape of the finger gesture and the position of this shape inrelation to the reference spot are matched with the shape and relativeposition parameters which of the stroke specification. Now, after amatch is found, a character and/or a command that is associated with thematched stroke specification may be used.

Optionally, the reference spot sensor 902 is based on one or moreoptical sensors, such as image sensors, that calculate the fingergesture relative to the reference spot by a known image processingprocesses. Optionally, the reference spot is set in advance. Forexample, the reference spot sensor 902 includes one or more opticalsensors that capture one or more reference images which are used as areference spot. Optionally, the reference spot is a segment that isselected in the one or more reference images. The aforementioned fingergesture is calculated relatively to the reference images.

It should be noted that in such an embodiment, the user may only movethe finger in order to create an input that is indicative of a characterand/or a command. In such a manner, user inputs may be created withoutmuch effort.

Reference is now made to FIG. 14, which a schematic illustration of areference zone that is used for controlling a command menu, optionallyhierarchical, according to some embodiments of the present invention.The reference zone 250 is optionally as described above and depicted,for example, in FIG. 2. Apart from being used as a reference for theposition of the user strokes, the reference zone may be used forconverting a user stroke and/or click to a menu selection and/ornavigation. In such a manner, a limited area in and around a referencezone that is displayed by an input surface, for example as describedabove, may be used for intercepting user strokes and/or clicks for bothcharacter and/or command inputs and menu selection and navigation. Thisability allows using a limited size human user interface, such as a 4.4centimeters touch screen, as a user input capable of providing fullcontrol over an electric device, such as a cellular phone, a personaldigital assistant (PDA), and/or any other multi application device. Insuch an embodiment, the human user interface 200 has a writing mode inwhich the aforementioned stroke recognition process is implemented and amenu mode in which the human user interface 200 allows the user tonavigate and make menu selections. When switching to the menu mode, forexample by clicking on the center of the reference zone 251 that isoptionally a circle, a plurality of virtual selection buttons 252 arepresented on the perimeter of the reference zone. Now, the user mayselect one of the selection options 252, for example by clicking thereonand/or by siding the pointing element from the center toward theselection options, for example as shown at FIG. 15.

In such an embodiment, the human user interface 200 allows the user toboth input alphabetic characters and digits and make menu selectionsaccording to a stroke based on a continuous touch gesture. It should benoted that the same reference area may allow the user to control acurser of a mouse, for example as described above, using stroke based ona continuous touch gestures.

As outlined above, the menu may be a hierarchical. In such anembodiment, each click on one of the virtual selection buttons triggersa swap in the virtual selection buttons which are presented to the user.For example, the first menu that is displayed is a primary sub menu, forexample a menu of some or all of the applications which hosted by adevice that uses the human user interface 200 or the primary sub menuwhich currently receives inputs from the human user interface 200, forexample as shown at 451 of FIG. 16. Then, after the user clicks on oneof the virtual buttons, a secondary sub menu appears, for example asshown at 452 of FIG. 16. Clicking on one of the virtual buttons maytrigger the execution of an application, sub application or the like,and/or trigger a swap between the secondary sub menu and a tertiary submenu. Such a progress along the hierarchical menu may proceed until thelast sub menu is displayed to the user.

Optionally, navigation among the virtual buttons in the menus isperformed by strokes, for example as shown at 453 of FIG. 16 or in thenavigation in FIG. 17.

Optionally, the user navigates along the sub menus of the hierarchicalmenu with a stroke based on a continuous touch gesture. Each time theuser slides the pointing element on top of a virtual button that isindicative of a sub menu, the displayed menus swap. When the userreleases the pointing element, for example detaches the pointing elementfrom the input surface, a selection is made. In such a manner, the usernavigates through a number of sub-menus in a stroke based on acontinuous touch gesture.

It is expected that during the life of a patent maturing from thisapplication many relevant systems and methods will be developed and thescope of the term controller, input surface, finger griping device, anda pointing element is intended to include all such new technologies apriori.

As used herein the term “about” refers to ±10%.

The terms “comprises”, “comprising”, “includes”, “including”, “having”and their conjugates mean “including but not limited to”. This termencompasses the terms “consisting of” and “consisting essentially of”.

The phrase “consisting essentially of” means that the composition ormethod may include additional ingredients and/or steps, but only if theadditional ingredients and/or steps do not materially alter the basicand novel characteristics of the claimed composition or method.

As used herein, the singular form “a”, “an” and “the” include pluralreferences unless the context clearly dictates otherwise. For example,the term “a compound” or “at least one compound” may include a pluralityof compounds, including mixtures thereof.

The word “exemplary” is used herein to mean “serving as an example,instance or illustration”. Any embodiment described as “exemplary” isnot necessarily to be construed as preferred or advantageous over otherembodiments and/or to exclude the incorporation of features from otherembodiments.

The word “optionally” is used herein to mean “is provided in someembodiments and not provided in other embodiments”. Any particularembodiment of the invention may include a plurality of “optional”features unless such features conflict.

Throughout this application, various embodiments of this invention maybe presented in a range format. It should be understood that thedescription in range format is merely for convenience and brevity andshould not be construed as an inflexible limitation on the scope of theinvention. Accordingly, the description of a range should be consideredto have specifically disclosed all the possible subranges as well asindividual numerical values within that range. For example, descriptionof a range such as from 1 to 6 should be considered to have specificallydisclosed subranges such as from 1 to 3, from 1 to 4, from 1 to 5, from2 to 4, from 2 to 6, from 3 to 6 etc., as well as individual numberswithin that range, for example, 1, 2, 3, 4, 5, and 6. This appliesregardless of the breadth of the range.

Whenever a numerical range is indicated herein, it is meant to includeany cited numeral (fractional or integral) within the indicated range.The phrases “ranging/ranges between” a first indicate number and asecond indicate number and “ranging/ranges from” a first indicate number“to” a second indicate number are used herein interchangeably and aremeant to include the first and second indicated numbers and all thefractional and integral numerals therebetween.

It is appreciated that certain features of the invention, which are, forclarity, described in the context of separate embodiments, may also beprovided in combination in a single embodiment. Conversely, variousfeatures of the invention, which are, for brevity, described in thecontext of a single embodiment, may also be provided separately or inany suitable subcombination or as suitable in any other describedembodiment of the invention. Certain features described in the contextof various embodiments are not to be considered essential features ofthose embodiments, unless the embodiment is inoperative without thoseelements.

Although the invention has been described in conjunction with specificembodiments thereof, it is evident that many alternatives, modificationsand variations will be apparent to those skilled in the art.Accordingly, it is intended to embrace all such alternatives,modifications and variations that fall within the spirit and broad scopeof the appended claims.

All publications, patents and patent applications mentioned in thisspecification are herein incorporated in their entirety by referenceinto the specification, to the same extent as if each individualpublication, patent or patent application was specifically andindividually indicated to be incorporated herein by reference. Inaddition, citation or identification of any reference in thisapplication shall not be construed as an admission that such referenceis available as prior art to the present invention. To the extent thatsection headings are used, they should not be construed as necessarilylimiting.

What is claimed is:
 1. A computing device having a human user interfaceallowing a user to navigate in a menu, comprising: an input surfacewhich: displays a reference zone; detects a user stroke drawn by a userand originated from a center of said reference zone; presents a menuhaving a plurality of virtual selection buttons on the perimeter of saidreference zone, each one of said plurality of virtual selection buttonsis indicative of an application, an application function or a sub menu;a processor; and a user stroke recognition module which: uses saidprocessor to identify a user selected virtual selection button from saidplurality of virtual selection buttons such that said user selectedvirtual selection button is located at the tip of said user stroke onthe perimeter of said reference zone, and triggers an execution of oneof a plurality of applications for execution, one of a plurality ofapplication functions for execution, or one of a plurality of sub menusfor presentation according to said user selected virtual selectionbutton.
 2. The computing device of claim 1, wherein said reference zoneis a virtual circle.
 3. The computing device of claim 1, wherein saiduser stroke is a continuous finger gesture of said user.
 4. Thecomputing device of claim 3, wherein said menu is a sub menu of ahierarchical menu, said user stroke recognition module being configuredfor navigating in said hierarchical menu and respectively swapping adisplay of said plurality of virtual selection buttons with a pluralityof additional virtual selection buttons of a plurality of sub menusaccording to said user stroke.
 5. The computing device of claim 1,wherein said reference zone is displayed on a touch screen.
 6. Thecomputing device of claim 1, wherein said computing unit is selectedfrom a group consisting of: a cellular phone, a phone, a remote control,an electric book, a game console, a camera, a laser pointer, anavigation system, a video recorder, a music player, and an audiorecorder.
 7. The computing device of claim 1, further comprising ahousing having a width of less than 5 millimeters for supporting saidinput surface and said user stroke recognition module.
 8. A method ofoperating a human user interface allowing a user to navigate in a menu,comprising: displaying a reference zone on a display; detecting a userstroke drawn by a user and originated from a center of said referencezone; presenting a menu having a plurality of virtual selection buttonson the perimeter of said reference zone, each one of said plurality ofvirtual selection buttons is indicative of an application, anapplication function or a sub menu; and selecting according to one ofsaid plurality of virtual selection buttons which is located at the tipof said user stroke on the perimeter of said reference zone one of aplurality of applications for execution, a plurality of applicationfunctions for execution or a plurality of sub menus of said menu forpresentation.
 9. The method of claim 8, wherein said reference zone isdisplayed on a touch screen having width and height of less than 4centimeters.
 10. The method of claim 8, wherein said displaying isperformed in response to a user clicking on the center of said referencezone.
 11. The method of claim 8, wherein said user stroke is an outcomeof sliding a pointing element from the center of said reference zonetoward one of said plurality of virtual selection buttons.
 12. Themethod of claim 11, wherein said sliding is performed on an input touchsurface.
 13. The method of claim 12, wherein said selecting is made whensaid user detaches the pointing element from said input touch surface.14. The method of claim 11, wherein said pointing element is a member ofa group consisting of: a finger, a stylus, and a laser marker.
 15. Themethod of claim 8, wherein said user stroke is a continuous touchgesture of said user.
 16. The method of claim 8, wherein said menu is aprimary menu and; further comprising swapping said plurality of virtualselection buttons with a plurality of additional virtual selectionbuttons each indicative of an item of a sub menu of said primary menu.17. The method of claim 16, wherein said sub menu is a secondary submenu; further comprising detecting a an additional stroke and swappingsaid plurality of additional virtual selection buttons with a pluralityof further additional virtual selection buttons each indicative of anitem of a tertiary sub menu of said primary menu.
 18. The method ofclaim 16, further comprising swapping said plurality of virtualselection buttons with a plurality of additional virtual selectionbuttons to allow said user to navigate through a plurality ofhierarchical sub menus in a user stroke based on a continuous touchgesture.
 19. The method of claim 8, further comprising dynamicallychanging the size of said reference zone according to said user stroke.20. The method of claim 8, wherein selecting comprises controlling,remotely or locally, a device according to said user selectedapplication or said user selected application function.